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I.        Introduction  &  Background 


The  Evaluation  of  Medicare  &  You  and  Medicare  CAHPS  in  Kansas  City  project, 
sponsored  by  the  Agency  for  Health  Care  Policy  and  Research  and  the  Health  Care 
Financing  Administration,  began  in  May  1998.  The  purpose  of  the  study  is  to  evaluate 
new  health  plan  materials  intended  to  educate  Medicare  beneficiaries  and  assist  in  health 
plan  decision  making.  The  study  uses  surveys  of  new  and  experienced  aged  Medicare 
beneficiaries  and  focus  groups  of  aged,  disabled,  and  dual-eligible  Medicare  and 
Medicaid  beneficiaries. 

This  report  presents  main  findings  from  the  focus  groups.  RTI  conducted  7  focus 
groups  with  a  total  of  56  participants.  Two  of  the  groups  were  primarily  with  aged  new 
beneficiaries,  2  were  with  aged  experienced  beneficiaries,  and  3  were  with  non-aged  dual 
eligibles  and/or  disabled  beneficiaries.1  Geographically,  5  of  the  groups  were  conducted 
in  Kansas  and  2  were  conducted  in  Missouri.  The  goal  of  the  focus  groups  was  to  learn 
what  Medicare  beneficiaries  thought  about  the  Medicare  &  You  handbook  and  the 
Medicare  CAHPS  report  (both  tailored  to  the  Kansas  City  area).  The  focus  groups 
provide  a  qualitative  perspective  to  complement  the  quantitative  data  collected  during  the 
telephone  surveys.  Separate  preliminary  descriptive  summaries  have  been  prepared  for 
the  survey  of  new  beneficiaries  and  the  survey  of  experienced  beneficiaries. 

This  report  describes  the  testing  design  and  implementation,  participant 
characteristics,  and  main  findings  based  on  debriefings  and  participant  answers  to  a 
questionnaire  administered  at  the  end  of  the  groups.  We  will  analyze  the  focus  group 
transcriptions,  conduct  further  analysis  of  the  groups,  and  share  any  additional  findings 
from  the  groups. 

II.       Testing  Design  and  Implementation 

The  main  research  questions  addressed  through  the  focus  groups  were: 

( 1 )  What  are  beneficiaries'  overall  impressions  of  the  Medicare  &  You 
handbook  and  the  Medicare  CAHPS  report? 

(2)  Do  beneficiaries  understand  the  purpose  and  intent  of  each  booklet? 

(3)  How  useful  do  beneficiaries  find  each  booklet  and  how  would  they  use 
each  booklet? 

(4)  How  much  do  beneficiaries  trust  the  information  in  the  booklets?  and, 

(5)  Are  there  any  aspects  of  the  booklets  that  are  problematic  for  participants? 

These  general  questions  and  more  specific  probes  are  shown  in  the  topic  guide  in 
Appendix  A.  To  avoid  order  effects,  in  about  half  the  groups  we  asked  first  about  the 


'We  originally  recruited  for  2  groups  with  dual  beneficiaries  and  2  groups  with  disabled  beneficiaries.  One 
of  the  dual  eligible  groups  did  not  occur  because  of  difficulty  obtaining  participants.  Within  the  remaining 
3  groups,  we  found  that  a  majority  of  disabled  participants  were  also  dual  beneficiaries. 


Medicare  &  You  handbook  and  in  the  other  half  we  asked  first  about  the  Medicare 
CAHPS  report. 

The  focus  group  format  is  one  which  research  has  shown  Medicare  beneficiaries 
tend  to  favor.  With  a  small  group,  there  is  less  pressure  on  any  one  participant  to  "be  on" 
during  the  entire  session.  Thus,  people  may  be  more  likely  to  relax  in  a  group  than  in  a 
one-on-one  interview. 

The  focus  groups  varied  in  size  from  7  to  10  participants.  The  groups  were 
conducted  in  conveniently  located  public  libraries  and  municipal  centers.  Those 
participants  who  did  not  already  have  a  copy  of  Medicare  &  You  and  the  Medicare 
CAHPS  report  prior  to  being  recruited  were  sent  a  copy  of  each  prior  to  the  session. 
Using  the  topic  guide,  a  trained  moderator  guided  participants  through  a  discussion  on  the 
predetermined  set  of  topics  and  encouraged  them  to  express  their  opinions  and 
experiences.  A  note  taker  was  also  present  to  observe  and  record  notes  on  verbal  and 
non-verbal  exchanges.  The  sessions  were  tape  recorded.  After  the  focus  group  was 
completed,  participants  were  asked  to  complete  a  short  questionnaire  {Appendix  B).  The 
purpose  of  the  questionnaire  was  to  obtain  demographic  information  that  we  did  not  have 
for  some  participants,  to  provide  all  participants  a  last  opportunity  to  share  opinions  about 
the  booklets  that  they  may  not  have  expressed  in  the  group,  and  to  get  some  quantitative 
feedback  on  comprehension  and  use  of  the  booklets.  Each  group  lasted  about  2  hours  and 
participants  received  a  $40  cash  incentive  after  the  group.  Participants  who  required 
special  transportation  (e.g.,  cab,  wheelchair  van)  were  reimbursed.  Immediately 
following  each  focus  group,  the  moderator  and  note  taker  debriefed  and  completed  a 
debriefing  form  to  convey  main  themes  and  illustrative  participant  quotes.  These 
debriefing  forms  were  analyzed  for  key  common  themes  and  differences  among  the 
groups. 

Unlike  a  sample  survey,  focus  group  findings  cannot  be  generalized  to  a  larger 
population.  In  addition,  group  dynamics  within  a  group  can  produce  a  bias,  since  some 
people  may  speak  less  because  of  others  or  a  group  may  be  swayed  by  the  opinions  of  1 
or  2  more  vocal  participants.  At  the  same  time,  focus  groups  are  a  rich  data  source 
through  which  we  can  obtain  in-depth  findings  that  may  help  explain  or  enhance  the 
findings  from  the  quantitative  data  analyses.  While  we  cannot  generalize  the  focus  group 
results,  our  confidence  in  focus  group  findings  increases  to  the  extent  that  patterns 
emerge  regardless  of  group  dynamics,  location,  and  moderator.  It  is  these  patterns  that 
we  present  in  this  document. 

III.     Participant  Characteristics 

We  used  multiple  avenues  for  recruiting  participants.  We  recruited  aged 
experienced  and  new  beneficiaries  from  those  who  participated  in  the  survey  component 
of  the  project  and  had  received  the  Medicare  &  You  handbook  (with  or  without  the 
Medicare  CAHPS  report).  For  disabled  and  dual  eligible  beneficiaries,  we  identified 
potential  participants  using  contacts  at  the  Kansas  City  HCFA  Regional  Office. 


Approximately  1 0  participants  were  recruited  through  an  advertisement  in  a  local 
newspaper.  All  participants  were  screened  to  ensure  their  eligibility  for  the  study. 

Table  1  provides  selected  characteristics  of  the  participants.  The  participants 
were  well  distributed  by  gender,  education,  marital  status,  race,  health  status, 
supplemental  insurance  type,  and  income.  Though  not  shown  in  a  table,  there  were  some 
differences  between  the  aged  beneficiaries  and  the  disabled/dual  eligible  beneficiaries. 
The  aged  beneficiaries  tended  to  have  higher  income,  better  self-assessed  health  status, 
and  were  more  likely  to  be  white  than  the  disabled/dual  eligible  beneficiaries.  By 
definition,  most  of  the  disabled/dual  eligible  beneficiaries  had  Medicaid  while  the  aged 
did  not. 


Table  1.        Selected  Characteristics  of  Kansas  City  Medicare  Focus  Group 
Participants 


Characteristics 

Participants 

(n  =  56) 

Gender 

Male 

26 

Female 

28 

Not  ascertained 

2 

Education 

Grades  1  -  8 

1 

Grades  9-11 

4 

Grade  12  (high  school  graduate  or  GED) 

14 

Some  college  or  technical  school 

19 

College  graduate  or  post-graduate  school 

13 

Not  ascertained 

5 

Marital  Status 

Married 

24 

Single 

29 

Not  ascertained 

3 

Hispanic  or  Latino  origin 

Yes 

0 

No 

52 

Not  ascertained 

4 

Race 

White 

36 

Black  or  African  American 

16 

Asian 

0 

Native  American  or  Alaskan  Native 

2 

Other 

0 

Not  ascertained 

2 

Health 

Excellent 

6 

Very  good 

17 

Good 

11 

Fair 

11 

Poor 

8 

Not  ascertained 

3 

Does  beneficiary  have  health  insurance  to  supplement  Medicare? 

Yes 

44 

No 

8 

Don't  know 

2 

Not  ascertained 

2 

Type  of  health  insurance  to  supplement  Medicare 

Medicaid 

16 

Self  purchased  supplemental  plan 

15 

Employer  provided  supplemental  plan 

14 

Not  ascertained 

11 

Total  annual  income  for  1997 

$10,000  or  less 

20 

$10,001  to  $15,000 

7 

$15,001  to  $20,000 

7 

$20,001  or  more 

16 

Not  ascertained 

6 

IV.      Main  Findings 


This  section  is  based  on  two  data  sources  collected  from  the  focus  groups:  (1) 
notes  and  quotations  from  the  focus  group  debriefing  sessions  and  (2)  responses  to  the 
post-questionnaire  administered  to  participants  after  each  group.  Since  the  results  from 
the  different  data  sources  generally  corroborate  each  other,  results  are  presented  by  topic 
rather  than  by  data  source.  Where  appropriate,  we  also  note  when  preliminary  descriptive 
findings  from  the  new  and  experienced  aged  Medicare  beneficiaries  survey  findings 
address  topics  similar  to  the  focus  group  findings.  Since  results  from  the  7  groups  are 
similar,  this  section  reflects  participants  in  all  groups.  Differences  are  noted  when  they 
occurred.  The  findings  from  the  focus  groups  are  organized  based  on  the  order  of  the 
questions  in  the  topic  guide  in  Appendix  A. 

A.       Findings  on  the  Medicare  &  You  Handbook 

/.        Overall  Impressions:  What  do  you  think  of  the  handbook? 

Across  the  7  focus  groups,  beneficiaries  generally  had  a  positive  response  to  the 
handbook.  People  saw  it  as  comprehensive,  understandable,  and  a  good  reference  to  save 
and  consult.  The  majority  of  beneficiaries  read  at  least  some  of  the  handbook.  About 
half  the  beneficiaries  said  they  read  the  entire  handbook  while  the  remaining  half 
skimmed  or  just  read  specific  sections.  The  following  quotes  illustrate  the  positive  tone 
among  the  groups. 

It 's  a  comprehensive  book  and  a  good  reference.  You  don 't  have  to  read 
the  entire  thing;  you  can  refer  to  it  later.  (Experienced  beneficiary) 

Provides  one  synopsis,  helped  me  make  a  decision,  and  helped  me  focus. 
(New  beneficiary) 

Easy  to  read  and  understand  and  get  you  on  the  right  path.  (Disabled/dual 
eligible  beneficiary) 

I  thought  it  was  pretty  well  written.  No  'legalese. '  Readable  in  language 
that  most  of  us  can  understand.  Definitely  an  improvement  over  other 
things  out  there.  (Disabled/dual  eligible  beneficiary) 

In  both  groups  composed  predominantly  of  new  beneficiaries  there  was  a  desire  to 
have  received  the  handbook  earlier  than  they  did,  so  people  could  use  it  when  choosing  a 
Medicare  plan.  Among  the  dual  eligible  participants,  there  was  a  sentiment  that  the 
information  was  less  relevant  to  them  because  Medicaid  paid  for  gaps  in  Medicare.  The 
dual  beneficiaries  wanted  to  see  more  information  in  the  handbook  about  how  the  2 
public  insurance  programs  coordinate  services  and  coverage.  However,  they  generally 
felt  the  information  in  the  handbook  was  important  and  valuable  to  them. 


The  cost  of  drugs  is  not  interesting  to  me  because  they  are  free. 
(Disabled/dual  eligible  beneficiary) 


2.        Comprehension:  What  is  the  main  purpose  of  the  handbook?  What  do  you 
think  the  handbook  is  trying  to  tell  people  on  Medicare? 

Participants  generally  gleaned  that  the  handbook  tells  them  about:  (1)  what 
Medicare  is  and  what  it  covers;  (2)  changes  in  Medicare,  including  the  new  managed  care 
plan  options;  and  (3)  other  choices  among  Medicare  options.  Representative  quotes 
below  address  these  3  main  areas. 


It  explains  really  well  Part  A&B.  (Experienced  beneficiary) 

It  tells  you  what  Medicare  will  do  for  you.  (New  beneficiary) 

It  goes  into  detail  about  the  Original  Medicare  Plan.  That  is  important 
because  you  know  where  you  stand.  [It]  tells  you  that  you  still  get  the 
Original  Medicare  Plan  when  you  are  in  an  HMO.  (Disabled/dual  eligible 
beneficiary) 

Medicare  &  You  alerts  beneficiaries  that  Medicare  is  changing. 
(Experienced  beneficiary) 

//  conveys  the  notion  of  choices.  Medicare  beneficiaries  can  choose.  (New 
beneficiary) 

Most  participants  also  mentioned  that  the  handbook  contains  comparative  information 
about  plan  benefits,  as  indicated  by  these  quotes. 

Good  comparative  information,  better  than  word  of  mouth.  (New 
beneficiary) 

Tells  us  what  they  [the  plans]  provide  and  what  they  don 't.  You  can 
figure  out  what  fits  you  for  what  you  need.  (New  beneficiary) 

Spells  out  what  each  HMO  takes  care  of  (e.g.,  prescription  limits),  so  you 
can  comparison  shop  between  HMOs.  (Disabled/dual  eligible  beneficiary) 

Some  beneficiaries  also  mentioned  recalling  the  information  about  rights  and 
appeals.  Participants  liked  having  such  information.  Several  participants  also  noted  that 
while  they  themselves  got  the  message  about  not  needing  to  change  plans,  it  should  be 
made  even  more  prominent.  This  might  be  accomplished  on  the  inside  cover  letter  by 
rewording  "...you  don't  have  to  do  anything"  to  "you  don't  have  to  change  the  type  of 
Medicare  coverage  you  now  have"  or  "you  can  stay  with  the  Medicare  coverage  you  now 


have"  or  similar  wording.  Several  beneficiaries  also  mentioned  that  the  fact  that 
Medicare  is  not  going  to  cover  everything  is  an  important  message  they  read. 

You  have  no  safety  net  with  Original  Medicare  but  with  a  Medicare  HMO 
you  do.  (Disabled/dual  eligible  beneficiary) 

Some  participants  also  acknowledged  that  since  Medicare  is  a  complex  system, 
they  appreciated  that  Medicare  &  You  is  an  attempt  to  help  beneficiaries  understand  it.  In 
general,  as  is  usual  with  information  about  Medicare,  participants  want  any  helpful 
information  they  can  get  about  this  often  challenging  topic.  One  participant  went  so  far 
as  to  say  that,  while  she  appreciates  the  handbook  information,  the  Medicare  program  is 
so  complex  that  no  written  materials  would  ever  successfully  explain  it. 

Even  though  the  book  is  very  well  written,  it  [Medicare]  is  getting  more 
and  more  complicated  and  us  senior  citizens  are  getting  less  and  less 
capable  of  making  good  decisions  and  it  is  almost  as  if  they  are  muddying 
the  waters  so  we  can 't  pick  out  the  best  thing  for  us.  And  as  we  get  older 
and  less  able,  other  people  are  going  to  have  to  do  [assist  us]  for  us  and  it 
is  almost,  I  am  thinking,  getting  too  confusing.  ...   /  think  all  of  this  is 
kind  of  a  cover-up  to  try  to  solve,  put  a  band-aid  on  a  very  serious 
lesion. 

Table  2  shows  selected  results  from  the  post-focus  group  questionnaire  about 
participants'  perceptions  of  the  handbook.  Most  participants  thought  the  Medicare  &  You 
handbook  was  easy  to  read  (somewhat  or  very).  As  found  in  the  preliminary  descriptive 
results  from  the  aged  Medicare  beneficiary  outcomes  surveys,  more  educated  persons 
generally  found  the  handbook  easier  to  understand  than  less  educated  persons  (not  shown 
in  Table  2).  Almost  everyone  thought  the  handbook  did  at  least  a  good  job  of  explaining 
the  advantages  and  disadvantages  of  each  type  of  Medicare  health  insurance.  This  is  also 
in  line  with  the  preliminary  descriptive  survey  results  (reported  separately),  where  about 
80  percent  of  beneficiaries  felt  that  the  Medicare  &  You  handbook  was  "good,"  "very 
good,"  or  "excellent"  at  helping  them  understand  the  advantages  and  disadvantages  of  the 
different  Medicare  plans. 

A  source  of  confusion  among  the  disabled/dual  eligible  participants  was  that  they 
may  not  be  eligible  for  the  Medicare  plans  because  of  their  age.  There  was  frustration 
both  over  the  lack  of  clarity  about  this  in  the  handbook  as  well  the  possibility  that  they 
may  not  be  eligible  because  they  are  too  young. 

It  gives  you  the  wrong  message.  I  shouldn  't  have  to  be  a  certain  age 
before  getting  into  a  plan.  (Disabled/dual  eligible  beneficiary) 

Rename  the  plans  or  specifically  say  that  there  are  no  age  restrictions  for 
HMOs.  (Disabled/dual  eligible  beneficiary) 
Table  2.        Selected  Attitudinal  Responses  to  Post-Focus  Group  Questionnaire: 


Medicare  &  You  Handbook 


Responses 

Participants 
(n  =  56) 

Comprehension 

In  general  how  hard  or  easy  is  the  Medicare  &  You  handbook  to 
understand? 

Very  hard 

1 

Somewhat  hard 

8 

Somewhat  easy 

28 

Very  easy 

16 

Not  ascertained 

3 

Rate  the  job  the  handbook  did  in  explaining  the  advantages  and 
disadvantages  of  each  type  of  health  insurance  for  people  with 
Medicare. 

Poor 

1 

Fair 

5 

Good 

33 

Excellent 

16 

Not  ascertained 

1 

Usefulness 

Looking  at  the  table  of  contents,  which  sections  of  the  Medicare  &  You 
handbook,  if  any,  did  you  find  most  useful?  (Circle  all  that  apply) 
The  top  four  sections  chosen  by  almost  half  of  the  participants: 

Learning  about  Medicare  health  plans 
(pp.  9-18) 

26 

Phone  numbers  for  assistance  (pp.  19a  - 

e) 

26 

What  is  the  Original  Medicare  plan?  (pp. 

2-5) 

24 

Medicare  patients'  rights  (p.  28) 

24 

Specific  sections:  Medigap  or  Medicare  SELECT  page 

Please  turn  to  page  30  of  the  Medicare  &  You  handbook.  When  you 
had  this  handbook  at  home,  do  you  recall  looking  at  this  page? 

Yes 

41 

No 

9 

Don't  remember 

5 

Not  ascertained 

1 

(Of  the  41  who  saw  page  30):  How  useful  was  page  30  to  you 
personally? 

Not  at  all  useful 

1 

Not  too  useful 

11 

Somewhat  useful 

22 

Very  useful 

7 

3.        Usefulness:  How  useful  to  you  is  the  information  in  this  handbook,  compared 
with  other  information  you  get  about  Medicare?  How  would  you  use  the 
information  in  the  handbook  to  help  you  make  decisions? 

Most  beneficiaries  said  they  found  the  handbook  useful,  both  absolutely  and 
relative  to  other  information  they  see  about  Medicare.  Participants  generally  agreed  that 
the  handbook  would  be  most  useful  for  people  changing  coverage  or  making  an  initial 
health  plan  decision.  When  asked  how  they  would  use  the  handbook,  the  most  popular 
response  was  to  use  it  as  a  reference  source.  Participants  noted  that  while  they  cannot 
absorb  all  of  the  information  at  one  time,  they  would  be  comfortable  going  back  to  the 
handbook  as  the  need  arose. 

/  couldn 't  digest  it  all...,  but  it 's  got  a  very  good  index.  I  could  go  back  to 
it,  keep  it  for  a  reference.  (New  beneficiary) 

Some  beneficiaries  also  mentioned  using  the  handbook  to  verify  information  from  other 
sources,  to  increase  their  confidence  in  their  current  health  plan  choices.  This  observation 
is  similar  to  what  the  preliminary  descriptive  results  from  the  aged  beneficiary  outcomes 
surveys  found,  that  some  beneficiaries  used  the  handbook  information  to  confirm  a  health 
plan  choice  they  had  already  made. 

When  asked  in  the  groups  what  other  aspects  of  the  handbook  they  found  most 
useful,  the  most  frequent  responses  were  its  convenience  (i.e.,  it  contains  information  "all 
in  one  place")  and  the  inclusion  of  plan  premium  information  (i.e.,  they  liked  seeing  costs 
included)  and  phone  numbers.  Phone  numbers  were  seen  as  a  way  to  enable  people  to  get 
additional  information  or  information  for  their  specific  needs  that  could  not  be  included 
in  the  handbook  (becuaes  of  length  constraints). 

/  would  keep  this  because  it  has  a  lot  of phone  numbers  to  call  for 
reference.  (Disabled/dual  eligible  beneficiary) 

Some  beneficiaries  said  that  when  they  tried  some  of  the  phone  numbers  in  the  handbook, 
sometimes  they  did  not  get  information  they  needed.  It  is  critical  that  the  phone  numbers 
in  the  handbook  be  accessible  (i.e.,  get  a  real  person  on  the  line)  and  able  to  address 
beneficiaries'  questions.  Otherwise,  frustration  and  mistrust  can  develop.  If  the 
infrastructure  is  not  in  place  now  to  handle  successfully  the  volume  and  types  of 
beneficiary  calls,  the  situation  (and  likely  fall  out)  will  only  worsen  as  the  National 
Medicare  Education  Program  strategy  relies  on  and  promotes  the  increasing  use  of  phone 
numbers  as  a  significant  means  for  addressing  beneficiary  information  needs. 

Participants  also  noted  liking  the  worksheet,  including  the  suggested  questions  to 
ask  and  the  steps  to  follow  for  choosing  a  plan,  as  noted  below. 

It  tells  you  questions  to  ask  that  you  might  not  have  thought  of  yourself. 
(Experienced  beneficiary) 


When  asked  in  the  post-questionnaire  to  choose  the  5  most  useful  sections  of  the 
handbook,  the  most  popular  sections  addressed  the  different  Medicare  options,  Original 
Medicare,  phone  numbers  for  assistance,  and  Medicare  patients'  rights.  Table  2  gives 
more  specific  information  on  these  sections. 

4.  Trust:  How  much  do  you  trust  the  information  in  the  handbook?  What 
difference,  if  any,  does  it  make  to  you  that  this  handbook  comes  from  the 
federal  government? 

Questions  about  people's  trust  in  the  handbook  produced  mixed  results.  While 
more  participants  trusted  it  than  did  not,  for  some  this  was  tempered  with  a  healthy 
skepticism.  Several  participants  noted  that  the  Federal  government  is  not  as  trustworthy 
now  as  it  was  when  they  were  young. 

Most  of  the  Medicare  crowd,  that 's  us,  think  that  the  government  is 
reputable...  we 've  grown  up  [trusting  in  the  government].  (New 
beneficiary) 

/  trust  the  government  not  to  lie.  The  person  who  wrote  the  book  wrote  it 
for  senior  citizens.  I  trust  the  government  not  to  try  to  take  advantage  of 
me.  (Experienced  beneficiary) 

/  trust  it  pretty  good.  Could  be  some  bias  about  some  things. 
(Disabled/dual  eligible  beneficiary) 

The  government  doesn  't  have  the  same  clout  as  it  used  to.  (Disabled/dual 
eligible  beneficiary) 

The  majority  felt  that  knowing  the  handbook  came  from  the  government  made  them  more 
likely  to  trust  it  and  see  it  as  unbiased  compared  to  other  sources.  A  majority  of 
participants  tended  to  trust  the  Medicare  &  You  handbook  more  than  they  trusted  the 
Medicare  CAHPS  report  or  individual  plans,  because  of  the  latter  2  sources'  focus  on 
HMOs. 

Insurance  companies  are  advertising—this  [handbook]  is  more 
trustworthy  than  health  insurance  stuff.  (Experienced  beneficiary) 

[It  makes  a  difference  knowing  it  s  from  the  government,]  because  they 
don 't  have  a  vested  interest  in  PPOs,  HMOs,  etc.  (Disabled/dual  eligible 
beneficiary) 


5.       Probing  on  Specific  Aspects  of  the  Medicare  &  You  Handbook 

a.        Please  take  a  few  minutes  to  look  over  pages  17 A  to  1 7M  of  the 
handbook.  How  useful  is  this  information  to  you? 

The  majority  of  beneficiaries  thought  that  this  section  gave  good  comparative 
information  on  what  different  plans  covered.  In  a  number  of  groups,  several  participants 
found  this  section  confusing  or  overwhelming.  Some  people  mentioned  that  they  had  no 
idea  initially  how  the  section  was  organized,  that  it  was  not  obvious  that  Kansas  was 
presented  first  followed  by  a  similar  presentation  for  Missouri.  A  contributing  factor  to 
the  confusion  may  be  that  what  is  highlighted  in  these  pages  is  not  the  state  but  the 
reference  to  "Kansas  metro  area,"  since  it's  projected  against  a  black  band.  Changing  the 
format  to  highlight  the  state  pages  could  help  address  this  problem.  As  one  participant 
noted  below,  using  different  colors  for  the  Kansas  and  Missouri  pages  may  also  help 
distinguish  these  2  sections.  Another  possible  source  of  confusion  may  be  that 
beneficiaries  did  not  realize  that  often  multiple  products  are  presented  within  the  same 
plan.  That  is,  participants  may  not  have  understood  why  there  were  so  many  columns  and 
how  they  differed.  We  address  this  issue  further  in  the  next  paragraph. 

The  charts  overwhelm  me.  I  had  to  really  dig.  They  had  Kansas  and 
Missouri.  It 's  a  lot.  (Experienced  beneficiary) 

Even  though  the  book  is  well  done,  the  book  is  getting  more  and  more 
complicated  [at  these  pages].  (Disabled/dual  eligible  beneficiary) 

Kansas  City  metro  area,  then  list  Kansas  separately — /  didn 't  realize  they 
were  separated.  It 's  confusing.  (Disabled/dual  eligible  beneficiary) 

'Colorize ' — give  different  colors  for  Kansas  and  Missouri,  so  it  '11  stand 
out — to  draw  attention.  (Disabled/dual  eligible  beneficiary) 

Some  participants  also  noted  that  the  Medicare  CAHPS  report  included  fewer 
plans  than  did  the  Medicare  &  You  handbook.  None  of  these  beneficiaries  knew  that  the 
difference  between  the  booklets  was  that  the  handbook  reported  all  products  within  the 
Medicare  plan  while  the  report  groups  products  within  a  plan.  In  fact,  some  participants 
incorrectly  concluded  that  the  smaller  number  of  plans  shown  in  the  report  had  been 
chosen  because  they  were  the  best  among  the  larger  number  of  "plans"  included  in  the 
handbook.  To  address  this  misunderstanding,  the  handbook  should  emphasize  that  the 
entities  shown  in  pages  1 7A  to  1 7M  include  all  Medicare  products  that  a  Medicare  plan 
offers.  A  brief  explanation  of  this  would  also  be  helpful. 


b.  Worksheet 


Beneficiaries  liked  the  worksheet  in  principle  and  thought  the  questions  were 
quite  valuable.  However,  very  few  beneficiaries  actually  filled  out  the  worksheet,  either 
because  they  were  happy  with  their  choice  or  had  already  made  a  choice  before  receiving 
the  handbook. 

/  think  it 's  a  very  valuable  tool.  (New  beneficiary) 

/  don 't  see  myself  getting  on  the  phone  and  getting  answers  to  all  50 
questions  in  the  worksheet,  but  I  guess  you  can  pick  and  choose  the 
questions  that  are  important  to  you.  (Disabled/dual  eligible  beneficiary) 

/  wish  I  had  these  questions  when  I  was  looking  for  an  HMO  three  years 
ago,  when  I  was  [a  new  beneficiary]  and  not  sure  what  was  going  on. 
This  is  better  information  than  I  received  back  then.  (Disabled/dual 
eligible  beneficiary) 

c.  Would  you  like  to  receive  the  handbook  in  the  mail  automatically  every 
year,  or  would  you  rather  return  a  postcard  to  ask  that  information  be 
sent  to  you,  only  when  you  need  it? 

Participants  gave  a  conditional  response  that  reflected  their  desire  to  balance  their 
need  to  know  about  Medicare  changes  with  their  concerns  about  waste  and  production 
and  mailing  costs  for  tax  payers.  If  there  are  any  changes  in  the  Medicare  program,  and 
thus  in  the  handbook,  the  majority  wanted  to  get  the  revised  handbook.  A  minority 
wanted  a  postcard  that  highlighted  the  main  changes  and  gave  people  the  chance  to  send 
it  back  to  receive  the  revised  handbook.  Everyone  thought  that  each  year  new  Medicare 
beneficiaries  should  get  the  handbook. 

In  the  interest  of  saving  money,  have  it  in  bindable  form.  Send  changes,  so 
you  can  stick  it  in  what  you  already  have.  (Disabled/dual  eligible 
beneficiary) 

If  there  are  changes,  you  '11  need  it.  There  '11  be  changes  each  year.  If  no 
changes,  send  only  to  new  recipients.  (Disabled/dual  eligible  beneficiary) 

d.  Usefulness  of  the  Medigap  or  Medicare  SELECT  page 

In  the  post-focus  group  questionnaire,  participants  were  asked  if  they  had  seen 
page  30  when  they  reviewed  the  handbook  at  home.  As  Table  2  shows,  most  had  seen 
this  page.  Of  those  who  saw  it  most  found  it  at  least  somewhat  useful,  though  a  minority 
did  not  find  it  useful. 

6.       Potential  areas  for  improvement  in  the  Medicare  &  You  Handbook 


This  section  conveys  some  suggestions  for  changes  made  by  beneficiaries  during 
the  focus  groups.  While  these  ideas  were  not  formally  probed  or  discussed  among  the 
focus  groups,  we  share  them  here  since  they  provide  further  insights  on  the  handbook 
from  the  beneficiary  perspective.  These  suggestions  may  be  helpful  as  HCFA  prepares  its 
Medicare  &  You  handbook  for  the  fall  1 999  national  mailing. 

Highlight  early  in  the  handbook  that  Medicare  does  not  cover 
prescriptions. 

Explain  why  there  are  2  parts  to  Medicare  (A  and  B)  and  not  1 . 

Devote  as  much  time  to  describing  PPO,  POS,  and  PSO  as  is  devoted  to 
describing  HMOs.  This  observation  may  well  reflect  the  fact  that  (a)  the 
only  actual  managed  care  plans  reported  in  the  handbook  and  in  the  report 
were  HMOs. 

Develop  a  definition  of  assignment  that  more  clearly  explains  both  what 
"Medicare  assignment"  and  "accepting  assignment"  mean. 

Consider  using  tabs  to  make  sections  and  topics  in  the  handbook  easier  to 
find. 

Consider  moving  the  Medicare  rights  page  earlier,  because  it  is  so  vital 
that  beneficiaries  know  that  they  have  recourse. 

Since  nursing  home  and  extended  care  facilities  are  not  included  in  the 
handbook  but  beneficiaries  may  want  to  learn  about  them,  include 
resources  (phone  numbers  and/or  publication  citations)  on  these  topics. 

Some  topics  (e.g.,  SLMB,  QMB,  Medicaid),  though  they  are  relevant  only 
to  a  subset  of  beneficiaries,  should  be  made  more  easily  accessible  to 
readers,  for  example  by  including  them  in  the  table  of  contents. 

B.      Findings  on  the  Medicare  CAHPS  report 

1.        Overall  Impressions:  What  do  you  think  of  the  report? 

As  they  did  with  the  handbook,  beneficiaries  responded  favorably  to  the  report 
overall.  Almost  everyone  read  at  least  some  of  the  report.  Some  participants  noted  that 
being  short  and  easy  to  read  was  an  attraction  that  made  them  more  likely  to  read  the  full 
report  than  to  read  the  handbook  in  its  entirety.  This  suggests  that  more  information  is 
not  necessarily  better;  beyond  some  threshold  level  of  information  beneficiaries  may  be 
less  likely  to  read  a  document  or  some  of  the  information  in  it.  Some  beneficiaries  noted 
multiple  times  the  absence  of  information  about  beneficiary  costs  and  would  like  to  have 
seen  it  included. 


In  general,  it  is  hard  to  make  a  factual  comparison  because  it  doesn 't 
include  cost.  (Experienced  beneficiary) 

//  doesn 't  have  the  specifics,  like  cost.  (Experienced  beneficiary) 

Some  participants  noted  that  the  report  is  primarily  relevant  for  people 
considering  or  choosing  an  HMO.  A  minority  mentioned  that  they  read  the  report  even 
though  they  are  not  interested  in  HMOs. 

If  I  had  to  choose  an  HMO,  it  would  tell  me  what  to  look  into.  (New 
beneficiary) 

2.        Comprehension:  What  is  the  main  purpose  of  the  report?  What  do  you  think 
the  report  is  trying  to  tell  people  on  Medicare? 

Participants  generally  took  away  several  basic  messages  from  the  report,  with  the 
first  being  that  the  report  compares  people's  choices  among  the  HMOs. 

It 's  supposed  to  help  you  choose  a  good  health  plan  or  HMO. 
(Experienced  beneficiary) 

Has  a  great  comparison.  Comparison  is  the  key  word.  (Experienced 
beneficiary) 

It  told  about  drugs,  choice  of  doctor,  how  much  time  they  spend— 
comparing  HMOs.  (Disabled/dual  eligible  beneficiary) 

All  of  us  want  to  know  more  than  just  what 's  covered  [by  each  plan].  I 
like  to  have  something  like  this,  like  Consumer  Reports,  which  has  helped 
me  buy  things  I  had  no  idea  about.  Gives  me  a  fighting  chance. 
(Disabled/dual  eligible  beneficiary) 

Second,  some  participants  noted  that  the  report  shows  differences  in  quality  across  plans. 

...there  obviously  is  a  difference  according  to  the  stars.  (New  beneficiary) 

Third,  some  participants  noted  that  the  information  in  the  report  came  from  a  survey  and 
that  the  information  compares  the  experiences  of  people  in  the  HMOs. 

It  looks  like  they 've  used  other  people 's  opinions.  (New  beneficiary) 

Fourth,  some  (less  than  half)  participants  thought  the  report  encouraged  readers  to  join  an 
HMO.  Some  participants  thought  that  simply  by  including  information  only  on  HMOs  in 
the  report,  the  report  was  "pushing"  HMOs.  Some  thought  that  the  report  should  state 


more  clearly  and  strongly  that  beneficiaries  can  keep  the  health  insurance  option  they 
have  and  do  not  need  to  enroll  in  an  HMO. 

Medicare  &  You  says  'If  you  're  ok  with  what  you  have,  stay  with  it ' 
[while]  CAHPS  is  pushing  me  to  HMOs.  CAHPS  doesn 't  stress  enough 
that  Medicare  is  essentially  ok  for  a  lot  of people,  that  they  don 't  need  an 
HMO.  (Disabled/dual  eligible  beneficiary) 

//  is  a  known  fact  that  the  administration  wants  people  to  go  into  HMOs. 
(Experienced  beneficiary) 

Fifth,  a  couple  of  participants  thought  that  the  report  was  for  marketing;  they  thought  that 
the  plan  that  performed  the  best  in  the  comparison  page  of  stars  (i.e.,  HealthNet  Senior 
Excel)  had  developed  the  report  for  marketing  purposes.  These  two  participants  also 
mentioned  that  the  professional,  attractive,  "slick"  look  of  the  report  contributed  to  their 
belief  that  it  was  a  marketing  brochure. 

When  I  first  read  the  booklet,  I  thought  it  was  a  sales  marketing  booklet,  to 
entice  you  to  buy  one  plan  or  another.  (Disabled/dual  eligible  beneficiary) 

/  thought  it  was  marketing  and  it  ticked  me  off.  [Since  HealthNet  did  so 
well,  I  thought]  this  is  HealthNet 's  scam  here.  (Disabled/dual  eligible 
beneficiary) 

Some  kind  of  pitch.  Why  not  put  in  other  non-HMO  options? 
(Disabled/dual  eligible  beneficiary) 

Finally,  as  occurred  with  the  Medicare  &  You  handbook,  some  of  the  disabled 
participants  thought  that  the  plan  names  and  descriptions  of  the  survey  respondents 
indicated  that  the  plans  were  only  for  older  people.  These  participants  were  frustrated 
that  they  may  not  be  eligible  for  the  Medicare  plans  and  frustrated  because  they  were  not 
sure  whether  this  was  the  case.  This  finding  holds  true  for  the  Medicare  &  You  handbook 
as  well. 

Table  3  shows  selected  results  from  the  post-focus  group  questionnaire  about 
participants'  perceptions  of  the  Medicare  CAHPS  report.  As  with  the  handbook,  and 
similar  to  results  from  the  preliminary  descriptive  results  for  the  aged  beneficiary 
outcomes  surveys,  most  participants  thought  the  report  was  easy  to  read  (somewhat  or 
very).  As  found  in  the  preliminary  descriptive  survey  results  and  in  the  focus  group 
results  for  the  handbook,  more  educated  persons  generally  found  the  report  easier  to 
understand  than  less  educated  persons  (not  shown  in  Table  3). 

As  one  objective  measure  of  comprehension  of  plan  performance  in  the  bars,  we 
asked  participants  to  choose  the  plans  that  performed  worse  than  most  others  on  page  12, 
"doctors  who  spend  enough  time  with  patients."  With  respect  to  this  measure,  Kaiser 


Permanent  Senior  Advantage  received  the  least  positive  scores.  Table  3  shows  that  most 
of  the  beneficiaries  correctly  chose  this  plan.  Overall,  most  participants  correctly 
interpreted  the  3-part  bar  graph  and  could  determine  which  plans  did  worse  than  others. 

Table  3.        Selected  Attitudinal  Responses  to  Post-Focus  Group  Questionnaire: 
Medicare  CAHPS  report 


Responses 

Participants 
(n  =  56) 

Comprehension 

In  general  how  hard  or  easy  is  the  Medicare  CAHPS  report 
to  understand? 

Very  hard 

1 

Somewhat  hard 

8 

Somewhat  easy 

24 

Very  easy 

18 

Not  ascertained 

5 

Which  plans  seem  to  be  doing  worse  than  most  others  on  page  12 
of  the  report,  "doctors  who  spend  enough  time  with  patients"? 
(multiple  response) 

All  seem  to  do  about  the  same 

2 

Blue  Cross  Blue  Advantage  65 

7 

Blue  Cross  Total  Health  Care  65 

5 

Humana  Gold  Plus 

6 

HealthNet  Senior  Excel 

4 

Kaiser  Permanente  Senior  Advantage2 

37 

Don't  know 

3 

Not  ascertained 

3 

Usefulness 

Choose  the  5  topics  most  important  to  you  among  the  1 5  presented  in 
the  report.  (Multiple  response) 

The  top  five  sections  chosen  by  at  least  half  of  the  participants: 

Getting  the  medical  care  you  need 

48 

Getting  the  prescriptions  you  need 

40 

2This  is  the  plan  that  received  the  least  positive  scores  on  the  measure  reported  in  the  table  and  is  the  correct 
response  to  the  post-focus  group  question  cited  in  the  table. 


Doctors  who  communicate  well  with  their  patients 

37 

Easy  to  get  referrals  to  specialists 

31 

Doctors  who  spend  enough  time  with  patients 

28 

3.  Usefulness:  How  useful  to  you  is  the  information  in  this  report,  compared  with 
other  information  you  get  about  Medicare?  How  would  you  use  the 
information  in  the  report  to  help  you  make  decisions? 

As  noted  previously,  participants  thought  this  report  would  be  most  useful  to 
people  already  interested  in  a  Medicare  HMO.  Some  people  noted  that  if  one  were  in  the 
market  for  an  HMO,  one  could  use  the  report  to  compare  plans.  Some  people  who  were 
in  an  HMO  used  the  report  to  see  how  their  plan  was  doing  and/or  to  validate  their 
choice. 

/  was  thrilled  to  death  with  this  [CAHPS  report]  because  my  plan  had  all 
the  best  numbers.  It  made  me  feel  very  good.  (Experienced  beneficiary) 

Some  beneficiaries  who  were  not  in  an  HMO  read  the  report  anyway  because  they 
thought  that  in  the  future  they  may  need  to  be  in  an  HMO  (because  of  personal  financial 
reasons  or  government  changes). 

As  noted  earlier,  participants  would  like  to  have  seen  premium  and  other  cost 
information  because  it  would  have  made  the  report  more  useful  to  them.  Participants 
were  generally  interested  in  other  people's  experiences  with  and  opinions  about  the  plans. 
Similar  to  their  perceptions  of  the  handbook,  beneficiaries  also  found  the  phone  numbers 
("aims  people  in  the  right  direction")  and  the  worksheet  ("suggested  questions  to  ask") 
useful. 

Participants  were  asked  to  choose  among  the  15  topics  in  the  Medicare  CAHPS 
report  the  top  5  that  were  most  important  to  them.  Table  3  shows  the  topics  chosen  by  at 
least  half  of  the  participants.  Medicare  beneficiaries  found  the  following  topics  most 
important  (in  descending  order) — getting  needed  medical  care,  getting  needed 
prescriptions,  doctors  who  communicate  well,  ease  of  getting  specialist  referrals,  and 
doctors  who  spend  enough  time  with  patients.  These  findings  corroborate  the  results  of 
similar  tasks  conducted  in  focus  groups  and  cognitive  interviews  with  privately  insured 
and  other  Medicare  populations.  Should  HCFA  need  to  choose  a  subset  of  CAHPS  topics 
to  report  to  consumers,  these  findings  can  help  inform  that  choice. 

4.  Trust'.  How  much  do  you  trust  the  information  in  the  report? 

In  interpreting  the  findings  about  trust,  please  keep  in  mind  that  Medicare 
beneficiaries,  like  the  larger  population,  often  have  preconceived  negative  ideas  about 
HMOs.  These  ideas  are  often  informed  by  what  beneficiaries  hear  in  the  media  and  learn 
from  friends  and  others.  Even  if  the  informational  material  is  unbiased  and  balanced, 
readers  may  see  it  as  partial  to  HMOs  because  of  their  preconceived  notions  or  simply 
because  it  only  presents  comparative  information  on  HMOs.  The  materials  that  present 
HMO  information  should  take  this  into  account  and  try  to  address  these  concerns  directly 
early  in  the  materials.  Including  comparative  CAHPS  data  for  the  local  Medicare  fee-for- 
service  population  would  also  alleviate  some  of  this  problem. 


As  with  the  handbook,  the  level  of  trust  in  the  report  was  mixed.  About  half  of 
the  beneficiaries  found  the  report  trustworthy  (and  some  of  these  participants  noted  that 
they  felt  this  way  because  they  thought  it  came  from  the  government). 

The  fact  that  it 's  copyrighted  lends  validity.  If  they  went  to  the  expense  of 
copyrighting  it,  then  it  must  be  legitimate.  (Experienced  beneficiary) 

My  opinions  are  in  line  with  the  survey  results;  it 's  accurate. 
(Experienced  beneficiary) 

It 's  important  to  read  government  books.  (New  beneficiary) 

About  half  thought  the  report  promoted  HMOs  and  were  suspicious  of  its  objectivity. 
Relatively  speaking,  participants  generally  trusted  the  report  more  than  they  trusted 
information  from  individual  plans. 

In  general  I  don 't  trust  surveys/polls  because  they  can  be  skewed.  In  the 
report  it  says,  'Adjustments  were  made.'  What's  that?  (Disabled/dual 
eligible  beneficiary) 

My  doctor 's  office  told  me  not  to  trust  it,  because  you  don 't  know  who  was 
surveyed  or  how  many  were  surveyed  for  each  plan.  (Disabled/dual 
eligible  beneficiary) 

5.        Probing  on  Specific  Aspects  of  the  Report 

a.        What  do  the  stars  tell  you  about  the  Medicare  HMOs?  What  is  the  chart 
on  these  pages  supposed  to  help  you  do?  What  is  the  difference  between 
the  information  that  the  bar  graphs  give  you  on  pages  7  to  17  and  the 
information  that  the  chart  gives  you  on  pages  5  and  6? 

Participants  generally  understood  that  three  stars  are  better  than  two  stars  and  that 
two  stars  are  better  than  one  star. 

HealthNet  is  obviously  better  with  all  the  stars.  (Experienced  beneficiary) 

Whether  they  are  good  or  bad.  Two  is  average;  three  is  excellent. 
(Disabled/dual  eligible  beneficiary) 

However,  only  a  small  minority  understood  the  relative  nature  of  the  stars  (i.e.,  that 
getting  one  star  does  not  necessarily  mean  that  a  plan  performed  poorly). 


A  plan  may  be  better  than  average  but  it  doesn  't  mean  it 's  great.  It  just 
means  it  is  better  than  the  average  of  all  the  plans.  (Disabled/dual  eligible 
beneficiary) 

Several  people  noted  that  they  see  stars  used  in  other  ways,  for  example  in  rating 
restaurants,  hotels,  movies,  and  banks.  It's  important  to  note  that  in  all  of  those  contexts 
stars  are  presented  in  an  absolute  rather  than  a  relative  context.  It's  easy  to  see  why 
people  would  view  the  stars  for  the  plans  also  in  an  absolute  way.  That  is  how  they  are 
used  to  thinking  about  them  in  other  areas  of  life,  as  described  below. 

Like  a  movie  rating.  When  I  look  at  the  TV  Guide,  I 'm  interested  in  4-star 
movies  and  I  might  consider  3-star  movies.  Anything  lower  I  disregard. 
(Disabled/dual  eligible  beneficiary) 

A  small  minority  compared  the  number  of  stars  a  plan  received  and  the  plan's  bar 
graph  results  and  noted  that  the  spread  between  plans  getting  different  numbers  of  stars 
does  not  have  to  be  that  large.  This  small  minority  noted  that  this  seemed  to  be  somewhat 
of  a  disconnect  between  the  bars  and  stars 

One  star  is  poor,  three  is  great.  Then  you  go  to  the  bars  and  that 's  not  so. 
(New  beneficiary) 

[The  stars  show  major  differences  but  in  the  bar  charts]  79%  -  64%  is  not 
much  of  a  difference.  (Disabled/dual  eligible  beneficiary) 

b.        Please  take  a  few  minutes  to  look  over  pages  18  to  21,  the  worksheet 

What  do  you  think  about  these  pages?  What  parts,  if  any,  did  you  use? 

Because  of  time  limitations,  only  two  groups  were  asked  about  the  worksheet 
Among  these  two  groups,  participants  generally  thought  the  questions  were  worthwhile 
The  preliminary  descriptive  results  from  the  aged  beneficiary  outcomes  surveys  found 
similar  perceptions,  with  beneficiaries  noting  that  the  questions  in  "Making  a  Choice: 
Things  to  Think  About"  were  among  the  most  useful  sections  of  the  report. 

/  looked  at  the  back  [pages  18-20].  It  suggests  that  you  ask  some  great 
questions.  (Experienced  beneficiary) 

Services,  convenient  time,  cost-all  the  things  you  should  consider  when 
you  are  choosing  an  HMO.  (Experienced  beneficiary) 

Yet,  as  with  the  handbook,  the  majority  of  participants  did  not  use  the  worksheet. 
Reasons  included  lack  of  interest  in  HMOs,  satisfaction  with  current  coverage,  and  the 
fact  that  the  report  came  after  participants  had  made  their  coverage  choice. 


C.  Summary 


In  general,  the  focus  group  findings  reflect  well  on  both  the  Medicare  &  You 
handbook  and  the  Medicare  CAHPS  report.  The  groups  also  revealed  some  interesting 
differences  between  aged  and  non-aged  beneficiaries  and  identified  some  areas  for 
possible  improvement  in  both  booklets. 

1.       Main  Impressions,  Comprehension,  Usefulness,  and  Trust 

Beneficiaries  generally  had  a  positive  response  to  both  the  Medicare  &  You 
handbook  and  the  Medicare  CAHPS  report.  Most  participants  saw  the  booklets  as 
understandable  and  thought  of  the  handbook  in  particular  as  a  good  reference  to  save  and 
consult.  Most  beneficiaries  gleaned  the  main  messages  of  each  booklet.  Participants 
noted  that  the  handbook  describes  what  Medicare  is  and  what  it  covers  (including  that  it 
does  not  cover  everything),  explains  changes  occurring  in  Medicare,  and  shows 
comparative  information  on  plan  choices.  They  recognized  that  the  report  provides 
comparative  information  on  Medicare  HMOs. 

Participants  thought  that  the  booklets  would  be  most  useful  for  people  changing 
coverage  or  making  an  initial  health  plan  decision.  Beneficiaries  also  noted  that  the 
CAHPS  report  would  be  useful  primarily  for  people  predisposed  to  HMOs.  While  most 
people  had  already  made  their  plan  choice  by  the  time  they  received  the  booklets,  some  of 
those  in  HMOs  used  the  booklets  to  verify  the  choices  they  made  before  getting  the 
booklets.  The  phone  numbers  were  one  of  the  more  popular  components  of  the  booklets. 
Participants  also  liked  having  the  plan  premium  information  in  the  handbook  and  would 
like  to  have  seen  it  in  the  CAHPS  report.  Beneficiaries  liked  the  worksheets  in  both 
booklets  and  thought  the  suggested  questions  to  ask  were  quite  valuable.  However,  very 
few  beneficiaries  actually  worked  through  the  worksheets,  either  because  they  were  happy 
with  their  choice  or  had  already  made  a  choice  before  receiving  the  booklets. 

The  groups  expressed  mixed  sentiments  regarding  their  level  of  trust  in  the 
booklets.  While  they  tended  to  trust  booklets  from  the  government  more  than  other 
sources,  some  participants  were  skeptical.  At  the  same  time,  participants  generally 
wanted  to  receive  the  handbook  on  an  annual  basis.  If  there  are  any  changes  in  the 
Medicare  program,  and  thus  in  the  handbook,  the  majority  of  participants  wanted  to  get 
the  revised  handbook.  Everyone  thought  that  each  year  new  Medicare  beneficiaries 
should  get  the  handbook. 

When  asked  about  the  star  comparison  chart  in  the  report,  participants  generally 
understood  that  three  stars  are  better  than  two  stars  and  that  two  stars  are  better  than  one 
star.  However,  as  has  been  found  in  other  focus  groups  with  Medicare  beneficiaries,  only 
a  minority  understood  the  relative  nature  of  the  stars  (i.e.,  that  getting  one  star  does  not 
necessarily  mean  that  a  plan  performed  poorly). 


2. 


Some  Potential  Areas  for  Improvement 


Within  both  the  handbook  and  the  CAHPS  report,  participants  thought  the 
message  about  not  needing  to  change  plans  should  be  made  even  more  prominent.  For 
pages  17A  to  17M  of  the  handbook  (comparative  plan  information),  consider  formatting 
and  text  changes  and  navigational  cues  to  help  readers  understand  that  the  section 
includes  (a)  different  markets  and  (b)  separate  listings  for  every  product  in  each  Medicare 
health  plan.  For  the  report,  highlight  early  that  beneficiaries  can  keep  the  health 
insurance  option  they  have  and  do  not  need  to  enroll  in  an  HMO  and  briefly  explain  why 
only  information  on  HMOs  is  included  in  the  report. 

3.       Main  Subgroup  Differences 

In  both  groups  composed  predominantly  of  new  beneficiaries  there  was  a  desire  to 
have  received  the  handbook  earlier  than  they  did,  so  people  could  use  it  when  choosing  a 
Medicare  plan.  The  dual  eligible  beneficiaries  wanted  to  see  more  information  in  the 
handbook  about  how  the  Medicare  and  Medicaid  programs  coordinate  services  and 
coverage  for  dual  eligible  beneficiaries.  Non-aged  disabled  beneficiaries  were  frustrated 
over  the  possibility  that  they  may  not  be  eligible  for  some  of  the  health  plans  listed  in  the 
booklets  because  they  are  too  young.  The  booklets  should  address  this  issue  more  clearly. 
Finally,  it  appears  that  more  educated  persons  generally  found  the  booklets  easier  to 
understand  than  less  educated  persons. 

It  is  important  to  remember  that  focus  groups  cannot  be  generalized  to  the  full 
population  from  which  their  participants  are  drawn.  In  addition,  these  conclusions  are 
based  on  a  limited  number  of  focus  groups  with  each  subpopulation.  At  the  same  time, 
the  report  findings  are  heartening  as  well  as  suggestive  of  possible  paths  for  improvement 
as  HCFA  prepares  it  Medicare  consumer  information  materials  for  the  first  national 
dissemination  of  the  Medicare  &  You  handbook  in  the  fall  of  1999. 


Appendix  A:  Topic  Guide 


Final  Focus  Group  Topic  Guide  (12/15/98) 
Medicare  Beneficiary  Discussion  Groups 

Introduction  (this  page:  10  minutes) 

Welcome.  Thank  you  for  coming  to  this  group  discussion.  Your  participation  is  very 
important. 

I'm  \ first  name]  and  Til  be  facilitating  our  group  today.  \First  name]  will  be  helping  me 
and  will  be  taking  notes  during  the  group.  We're  from  Research  Triangle  Institute,  a 
non-profit  organization  that  does  health-related  research.  We  are  conducting  these 
groups  for  the  agency  that  manages  the  Medicare  program. 

Project  Objective 

The  Medicare  program  is  trying  to  learn  more  about  what  information  people  who  have 
Medicare  want  and  how  best  to  give  it  to  them. 

Group  Objective 

As  part  of  this  effort,  we  are  conducting  these  discussion  groups  with  people  like  you 
who  have  Medicare,  to  learn  what  you  think  about  the  materials  that  Medicare  has 
developed  for  people  who  have  Medicare- 
Confidentiality  Statement 

Your  participation  today  is  voluntary  and  confidential.  You  may  refuse  to  answer  any 
question  and  you  can  refuse  to  participate  further  at  any  point.  This  will  have  no  effect 
on  your  health  insurance.  We  will  write  a  summary  report  across  all  the  groups  we  do. 
and  it  will  be  impossible  to  identify  what  any  individual  said.  I  would  like  to  have  an 
open  conversation  today,  so  people  are  comfortable  saving  whatever  they  feel. 
Everything  we  say  in  this  room  today  stays  here. 

[If  participants  have  not  already  done  so.  have  them  complete  the  informed  consent  form 
and  collect  them.  Remind  them  that  1  copy  is  for  them  to  keep,  with  phone  numbers  in 
case  they  have  questions  afterwards.  J 

Focus  Group  Procedure 

We'll  be  having  an  open  conversation,  so  feel  free  to  respond  to  me  and  others  in  the 
group  without  waiting  to  be  called  on.  But  only  one  person  should  talk  at  a  time- 
Last  about  2  hours.  I  may  move  us  along,  since  we  have  a  lot  to  discuss. 
[ Explain  where  bathrooms  are.  J 

flf  applicable,  say}  Since  we  won't  have  a  break,  feel  free  to  get  up  and  get 
something  to  drink  or  eat  during  the  discussion. 
Feel  free  to  ask  if  you  did  not  understand  a  question. 

There  are  no  right  or  wrong  answers.  We  want  to  hear  from  everyone.  You're  the 
experts. 

Please  give  your  frank  &  honest  opinions  of  the  materials.  We're  here  to  learn  from 
you. 


We  will  be  audio-taping  for  analysis  only.  Please  raise  your  hand  if  that's  ok  with 
you. 

I'll  be  using  this  topic  guide  today  to  help  make  sure  that  we  cover  everything  we 
need  to. 


[Underlined  probes  are  top  priorities  and  must  be  covered.  Non-underlined  probes 
should  be  covered  as  time  permits.  Probes  in  parentheses  are  supplemental,  to  be  used  if 
needed.  J 

I.  Ice-breaker  round-robin  (15  minutes) 

I .  Well  be  on  a  first  name  basis  today.  [  Write  descriptors  for  3  items  requested  on 
board]  I'd  like  to  begin  by  asking  you  to  tell  us  your  first  name,  how  long  you've  had 
Medicare,  and  where  vou  usually  get  information  about  Medicare.  [Write  information 
sources  on  post  it  page.] 

[MODERA  TORS:  For  your  first  group,  address  Section  II  before  section  III  For  your 
second  groups,  address  sections  II  before  section  II.  Underline  which  section  you  start 
with  here:  II  or  III.] 

II.  Medicare  &  You  Handbook  (45  minutes)  (Groups  I,  4,  6,  and  8  start 
with  this  section) 

A.  Overall  Impressions 

L  Does  everyone  have  the  Medicare  &  You  handbook  [hold  up  handbook]1?  [If  not, 

pass  out  copies  of  M&Y  handbook  to  those  who  do  not  have.] 

2a,  Fd  like  a  show  of  hands.  Who's  had  a  chance  to  read  at  least  some  of  this 

handbook  before  coming  here  today? 

2b.    [If  at  least  some  raise  their  hands,  ask]:  How  much  of  the  handbook  did  you  read? 
[If  not  much,  ask]:  What  would  have  made  you  read  more?  (Why  didn't  you  read 
more?) 

3.     What  do  vou  think  of  the  handbook? 

B.  Comprehension 

L  What  is  the  main  purpose  of  the  handbook?  (What  is  this  handbook  supposed  to 

help  you  do?) 

2.  What  do  vou  think  the  handbook  is  trying  to  tell  people  on  Medicare?  (What  are  the 

main  messages?) 

C.  Usefulness 

L  How  useful  to  vou  is  the  information  in  this  handbook,  compared  with  other 

information  vou  get  about  Medicare? 


2.     How  would  you  use  the  information  in  the  handbook  to  help  you  make  decisions? 
(For  what  kinds  of  decisions  would  you  use  this  handbook?) 


D.  Trust 

1 .  How  much  do  you  trust  the  information  in  the  handbook? 

2.  What  difference,  if  any,  does  it  make  to  you  that  this  handbook  comes  from  the 
federal  government? 

E.  Specific  Probes  of  M&Y  Handbook 

1 .  Please  take  a  few  minutes  to  look  over  pages  1 7A  to  1 7M  of  the  handbook.  How 
useful  is  this  information  to  you? 

2.  Please  take  a  few  minutes  to  look  over  pages  20  to  25.  the  worksheet.  What  do  you 
think  about  these  pages?  What  parts,  if  any,  did  you  use? 

3.  {Write  short  version  of  each  choice  on  board.  Get  a  show  of  hands  for  each  choice- 
-they  can  only  choose  one.  Note  taker  record  distribution]  Would  you  like  to 
receive  the  handbook  in  the  mail  automatically  every  year,  or  would  you  rather 
return  a  postcard  to  ask  that  information  be  sent  to  you,  only  when  you  need  it? 

4.  When  you  used  the  handbook,  did  you  try  calling  any  of  the  phone  numbers?  What 
was  your  experience  like  when  you  called  the  number(s)? 


III.    CAHPS  Survey  Report  (40  minutes) 
A.    Overall  Impressions 

1 .     Does  everyone  have  this  report  (hold  up  CAHPS  report]?  [If  not,  pass  out  copies  of 
CAHPS  report  to  those  who  do  not  have  it.] 

2a.    Fd  like  a  show  of  hands  again.  Who's  had  a  chance  to  read  at  least  some  of  this 
report  before  coming  here  today? 

2b.    [If  at  least  some  raise  their  hands,  ask]:  How  much  of  the  report  did  you  read? 
[If  not  much,  ask]:  What  would  have  made  you  read  more?  (Why  didn't  you  read 
more?) 
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What  do  you  think  of  the  report? 


B.  Comprehension 

1 .  What  is  the  main  purpose  of  the  report?  (What  is  this  report  supposed  to  help  you 
do?) 

2.  What  do  you  think  the  report  is  trying  to  tell  people  on  Medicare?  (What  are  the 
main  messages?) 

3.  What,  if  anything,  did  the  report  tell  you  about  the  quality  of  medical  care  from 
different  Medicare  HMOs?  (Based  on  what  you  read  of  the  report,  what  kinds  of 
differences  are  there  between  Medicare  HMOs?) 


C.  Usefulness 

1 .  How  useful  to  you  is  the  information  in  this  report,  compared  with  other 
information  you  get  about  Medicare? 

2.  How  would  you  use  the  information  in  the  report  to  help  you  make  decisions?  (For 
what  kinds  of  decisions  would  you  use  this  report?) 

3.  How  interested  are  you  in  other  people's  opinions  about  health  plans? 


D.  Trust 

1 .  How  much  do  you  trust  the  information  in  the  report? 

2.  How  accurately  do  you  think  the  information  in  this  report  reflects  what  most 
Medicare  HMO  members  think  about  their  plan? 

E.  Specifics  Probes  of  the  Medicare  CAHPS  report 

1 .  Please  take  a  few  minutes  to  look  over  pages  5  and  6  of  the  report  and  please  read 
the  green  section  on  page  5.  What  do  the  stars  tell  you  about  the  Medicare  HMOs? 
What  is  the  difference  between  a  plan  that  gets  1  star  and  a  plan  that  gets  2  stars  on 
the  topic  "getting  the  medical  care  you  need"?  What  is  the  chart  on  these  pages 
supposed  to  help  you  do? 

2.  What  is  the  difference  between  the  information  that  the  bar  graphs  give  you  on 
pages  7  to  1 7  and  the  information  that  the  chart  gives  you  on  pages  5  and  6?  [If 
people  generally  don 't  understand  the  difference,  have  them  focus  on  one  survey 
topic— page  11  and  "doctors  who  communicate"  on  pages  5-6.  Ask  them  what 
information  they  get  from  these  two  different  pages  on  this  same  topic] 


3.  Please  take  a  few  minutes  to  look  over  page  4.  What  is  this  page  telling  you  about? 
[If  necessary,  probe  what  it  tells  them  about  a  "network.  "J  How  useful  is  this  page 
useful  to  you  personally? 

4.  Please  take  a  few  minutes  to  look  over  pages  1 8  to  2 1 ,  the  worksheet.  What  do  you 
think  about  these  pages?  What  parts,  if  any,  did  you  use? 


IV.    Wrap-up  (10  minutes) 

1 .  Is  there  anything  we  did  not  discuss  that  seems  relevant?  [If  time  permits,  check  with 
note  taker,  regarding  any  last  questions  or  need  for  clarification.] 

2.  Thanks  again  for  all  your  comments  on  the  materials.  You  have  really  helped  us  in 
thinking  more  about  ways  to  meet  the  information  needs  of  people  who  have 
Medicare  and  their  families. 

3.  As  our  last  activity,  I'd  like  you  to  complete  the  questionnaire  that  we'll  be  giving 
you.  It  should  take  about  5  to  1 0  minutes  to  complete.  If  you  have  any  questions  as 
you  fill  out  the  questionnaire,  please  ask  me  or  [note  taker 's  name]  and  we'll  be  glad 
to  help.  Once  you  fill  out  the  questionnaire,  as  a  token  of  our  appreciation,  we'll  be 
handing  out  these  envelopes  and  a  receipt  form.  Once  you  sign  the  receipt  form,  you 
will  be  finished.  (Please  help  yourself  to  the  remaining  refreshments  and)  thanks 
again  for  your  help  and  have  a  good  [afternoon/evening]. 

4.  Administer  profile  form  and  collect.  Hand  out  incentives  and  receipts  forms  and 
collect  signed  receipt  forms. 


Appendix  B:  Post-Focus  Group  Questionnaire 


Post  Discussion  Group  Questionnaire 

Please  write  in  your 

name:  

Your  answers  will  be  kept  completely  confidential. 

Please  answer  the  questions  below  by  circling  the  number  for  your  answer 
or  writing  down  your  answers.  When  you  are  finished,  please  return  your 
completed  questionnaire  before  you  leave. 

Questions  about  the  Medicare  &  You  Handbook  (Red,  White,  and  Blue 
colors) 

1 .  In  general,  how  hard  or  easy  is  the  Medicare  &  You  handbook  to 
understand?  (circle  one  answer) 

5.  Very  hard 

6.  Somewhat  hard 

7.  Somewhat  easy 

8.  Very  easy 

2.  Is  there  anything  confusing  about  the  Medicare  &  You  handbook? 
(circle  one  answer) 

1.  Yes 

2.  No— >  GO  TO  QUESTION  4 


3. 


Briefly  describe  what  is  confusing  about  the  handbook,  (write  in 
your  answer) 


4.      Rate  the  job  the  handbook  did  in  explaining  the  advantages  and 
disadvantages  of  each  type  of  health  insurance  for  people  with 
Medicare,  (circle  one  answer) 

1.  Poor 

2.  Fair 

3.  Good 

4.  Excellent 


5.      Please  turn  to  page  30  of  the  Medicare  &  You  handbook.  When  you 
had  this  handbook  at  home,  do  you  recall  looking  at  this  page? 
(circle  one  answer) 

1 .  Yes,  looked  at  it 

2.  No,  did  not  look  at  it— >  GO  TO  QUESTION  7  ON  NEXT  PAGE 

3.  Don't  remember— >  GO  TO  QUESTION  7  ON  NEXT  PAGE 


6.      How  useful  was  page  30  to  you  personally?  (circle  one  answer) 

1 .  Not  at  all  useful 

2.  Not  too  useful 

3.  Somewhat  useful 

4.  Very  useful 


GO  TO  NEXT  PAGE 


7.      Please  look  at  the  inside  front  cover  of  the  Medicare  &  You  handbook 
for  the  table  of  contents.  Please  look  on  this  page  for  the  list  of 
sections  in  the  handbook.  Which  sections  of  the  handbook,  if  any, 
did  you  find  most  useful?  (circle  all  that  apply) 

1 .  None 

2.  All 

3.  Introduction 

4.  What  is  the  Original  Medicare  Plan 

5.  Learning  About  Medicare  Health  Plans 

6.  Phone  Numbers  for  Assistance 

7.  Worksheet  for  Comparing  Medicare  Health  Plans 

8.  Questions  and  Answers—Other  Medicare  Health  Plans 

9.  Medicare  Patients'  Rights 

10.  Private  Supplemental  Insurance  Policies 

1 1 .  Questions  and  Answers—Original  Medicare  Plan 

12.  Protect  Yourself  Against  Discrimination,  Fraud,  and  Abuse 

13.  Index 


Questions  about  the  Compare  Your  Health  Plan  Choices  Report  (Green 
Color) 

8.  In  general,  how  hard  or  easy  is  the  Compare  Your  Health  Plan 
Choices  report  to  understand?  (circle  one  answer) 

1 .  Very  hard 

2.  Somewhat  hard 

3.  Somewhat  easy 

4.  Very  easy 

9.  Is  there  anything  confusing  about  the  Compare  Your  Health  Plan 
Choices  report?  (circle  one  answer) 


1.  Yes 

2.  No— >  GO  TO  QUESTION  1 1  ON  NEXT  PAGE 


10.     Briefly  describe  what  is  confusing  about  the  report,  (write  in  your 
answer) 


1 1 .     Please  look  over  the  1 5  topics  listed  below.  They  are  also  listed  on 
page  5  of  the  Compare  Your  Health  Plan  Choices  report.  Choose  the 
top  5  topics  from  the  list  below  that  are  most  important  to  you. 
Number  them  below  1,  2,  3,  4,  and  5,  where  1  is  the  most  important,  2 
is  the  next  most  important,  and  so  on  up  to  5.  (write  in  below  the 
numbers  1  through  5  for  your  top  5  most  important  items) 

 Getting  the  medical  care  you  need 

 Getting  the  prescriptions  you  need 

 Getting  care  without  long  waits 

 Getting  a  flu  shot 

 Doctors  who  communicate  well  with  their  patients 

 Doctors  who  spend  enough  time  with  patients 

 Easy  to  find  a  personal  doctor  you  are  happy  with 

 People's  rating  of  their  personal  doctor 

 People's  rating  of  the  specialists  they  have  seen 

 Courtesy,  respect,  and  helpfulness  of  office  staff 

 People's  rating  of  their  health  plan 

 Easy  to  get  referrals  to  specialists 

 Efficient  &  helpful  customer  service 

 Reasonable  paperwork,  handling  of  approvals,  &  payments 


GO  TO  NEXT  PAGE 


12.  Please  look  at  page  12  of  the  Compare  Your  Health  Plan  Choices 
report,  about  doctors  who  spend  enough  time  with  patients.  Which 
plans  seem  to  be  doing  worse  than  most  others  on  this  topic?  (circle 
all  that  apply) 

1 .  All  seem  to  do  about  the  same 

2.  Blue  Cross  Blue  Advantage  65 

3.  Blue  Cross  Total  Health  Care  65 

4.  Humana  Gold  Plus 

5.  HealthNet  Senior  Excel 

6.  Kaiser  Permanente  Senior  Advantage 

7.  Don't  know 

1 3 .  Please  take  a  few  minutes  to  look  over  pages  1 8  to  2 1 ,  for  the 
worksheet.  When  you  received  this  handbook  at  home,  did  you  use 
any  part  of  these  pages?  (circle  one  answer) 

1.  Yes 

2.  No— >GO  TO  QUESTION  1 5 

14.  Please  briefly  describe  what  pages  or  sections  you  used  and  how  you 
used  them,  (write  in  your  answer) 


15.     Is  there  anything  that's  confusing  on  pages  18  to  21?  (circle  one 
answer) 

1.  Yes 

2.  No— >  GO  TO  QUESTION  1 7 


1 6.     Briefly  describe  what  is  confusing  about  pages  1 8  to  2 1 .  (write  in 
your  answer) 


The  last  questions  are  for  analysis  reasons  only. 


1 7.  What  is  your  gender?  (circle  one  answer) 

1.  Male 

2.  Female 

18.  What  is  the  highest  grade  or  year  of  school  you  have  completed? 
(circle  one  answer) 

1.  Grades  1-8 

2.  Grades  9-11 

3.  Grade  12  (high  school  graduate  or  GED) 

4.  Some  college  or  technical  school 

5.  College  graduate  or  post-graduate  school 

19.  What  is  your  marital  status  now?  (circle  one  answer) 

1 .  Married 

2.  Single 

20.  Are  you  of  Hispanic  or  Latino  origin?  (circle  one  answer) 

1.  Yes 

2.  No 


2 1 .    What  is  your  race?  (circle  all  that  apply) 

1.  White 

2.  Black  or  African  American 

3.  Asian 

4.  Native  American  or  Alaskan  Native 

5.  Other,  please  specify  


22.  Do  you  currently  have  any  health  insurance  that  helps  pay  for  some  of 
the  medical  services  that  Medicare  doesn't  pay  for?  (circle  one 
answer) 

1.  Yes 

2.  No  — >  GO  TO  QUESTION  24 

23.  What  kind  of  health  insurance  plan  is  it?  (circle  one  answer) 

1 .  Medicaid 

2.  A  supplemental  plan  you  purchased  (not  through  an  employer  or 
spouse's  employer) 

3.  A  supplemental  plan  you  purchased  or  received  through  and 
employer  or  spouse's  employer 

4.  Don't  know 

24.  Is  your  Medicare  health  insurance  plan  a  Medicare  HMO  or  Health 
Maintenance  Organization?  (circle  one  answer) 

1.  Yes 

2.  No 

3.  Don't  know 

25.  What  is  your  household's  total  annual  income  before  taxes  in  1997? 
(circle  one  answer) 

1.  $5,000  or  less 

2.  $5,001  to  $10,000 

3.  $10,001  to  $15,000 

4.  $15,001  to  $20,000 

5.  $20,001  to  $30,000 

6.  $30,001  or  more 

26.  Including  yourself,  how  many  people  does  your  income  support? 
(write  in  number  of  people) 


27. 


In  general,  would  you  say  your  health  is....  (circle  one  answer) 


1 .  Excellent 

2.  Very  good 

3.  Good 

4.  Fair 

5.  Poor 

28.     For  what  reason  did  you  first  become  eligible  for  Medicare?  (circle 
one  answer) 

1 .   Because  of  a  disability  (please  briefly  describe  the 

disability)  


2.  Because  you  turned  age  65 

3.  Other  (please  briefly 
explain)  


Thank  you  for  your  help!! 
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